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DETAILED ACTION 

1 . Applicant has amended claims 1 , 1 2, 1 7, 1 8, 1 9, 25, 26, 27, 50, 55, 67, 75, 87, 
92, 93 and canceled claims 9-11, 20-24, 28-49, 51, 89-90, 94-100 in the amendment 
filed on 9/26/2005. 

Claims 1-8, 12-19, 25-27, 50, 52-88, and 91-93 are pending in this office action. 



EXAMINER'S AMENDMENT 

2. An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1 .312. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview 
with attorney Anne Saturnelli on 11/25/2005. 
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1 . (Currently Amended) A computer implemented method for producing a visual 
form of data comprising: 

receiving data representing the visual form of data, the data received comprising 
content data and format data indicating a manner in which the content data is to be 
visually represented, wherein said format data is applied to said content data to produce 
said visual form of data, said visual form of data corresponding to one of a print format 
or a display format; 

receiving data indicating a location of selected data; 

forming an extraction instruction based on location data identifying the location of 
selected data; 

analyzing said visual form of data using a template and identifying at least some 
of the content data in accordance with said template after applying said format data to 
said content data to produce said visual form of data, said visual form of data being 
characterized by a plurality of dimensions represented using a coordinate system, said 
template including said extraction instruction used in identifying a location of a string 
included in said content data, said location of the string being represented using the 
coordinate system and corresponding to the location of the string as represented in the 
visual form of data, said extraction instruction including information with respect to a 
reference marker and a direction in one of the plurality of dimensions where identifying 
at least some of the content data includes searching in the direction for identifying at 
least some of the content data in the direction; 
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extracting a tag value for at least one tag identified in said template; and 
storing the identified at least some of content data. 

16. (Currently Amended) The method of claim 15 wherein storing the identified at 
least some of content data further includes storing the identified at least some of 
content data in association with the data representing a corresponding one of a 
plurality of visual forms of data. 

17. (Currently Amended) Computer readable media containing a computer program 
to produce a visual form of data, comprising instructions for: 

receiving data representing the visual form of data, the data received comprising 
content data and format data indicating a manner in which the content data is to be 
visually represented, wherein said format data is applied to said content data to produce 
said visual form of data, said visual form of data corresponding to one of a print format 
or a display format; 

receiving data indicating a location of selected data; 

forming an extraction instruction based on location data identifying the location of 
selected data; 

analyzing said visual form of data using a template and identifying at least some 
of the content data in accordance with said template after applying said format data to 
said content data to produce said visual form of data, said visual form of data being 
characterized by a plurality of dimensions represented using a coordinate system, said 
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template including said extraction instruction used in identifying a location of a string 
included in said content data, said location of the string being represented using the 
coordinate system and corresponding to the location of the string as represented in the 
visual form of data, said extraction instruction including information with respect to a 
reference marker and a direction in one of the plurality of dimensions where identifying 
at least some of the content data includes searching in the direction for identifying at 
least some of the content data in the direction; 

extracting a tag value for at least one tag identified in said template; and 

storing the identified content data as at least one tag value. 

18. (Currently Amended) Computer system for producing a visual form of data 
comprising: 

a input port receives data representing the visual form of data, the data received 
comprising content data and format data indicating a manner in which the content data 
is to be visually represented, wherein said format data is applied to said content data to 
produce said visual form of data, said visual form of data corresponding to one of a print 
format or a display format, said input port receiving data indicating a location of selected 
data; 

a processor forms an extraction instruction based on location data identifying the 
location of selected data, analyzes said visual form of data using a template and 
identifies at least some of the content data in accordance with said template after 
applying said format data to said content data to produce said visual form of data, 
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wherein said visual form of data being characterized by a plurality of dimensions 
represented using a coordinate system, wherein said template including said extraction 
instruction used in identifying a location of a string included in said content data, said 
location of the string being represented using the coordinate system and corresponding 
to the location of the string as represented in the visual form of data, said extraction 
instruction including information with respect to a reference marker and a direction in 
one of the plurality of dimensions where identifying at least some of the content data 
includes searching in the direction for identifying at least some of the content data in the 
direction, said processor extracting a tag value for at least one tag identified in said 
template; and 

a storage media stores the identified the at least some of content data as at least 
one tag value. 

1 9. (Currently Amended) A method computer implemented for processing a visual 
form of data comprising: 

transmitting a computer program comprising instructions for: 
receiving data representing a visual form of data, the data received comprising 
content data and format data indicating a manner in which the content data is to be 
visually represented, wherein said format data is applied to said content data to produce 
said visual form of data, said visual form of data corresponding to one of a print format 
or a display format; 

receiving data indicating a location of selected data; 
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forming an extraction instruction based on location data identifying the location of 
selected data; 

analyzing said visual form of data using a template and identifying at least some 
of the content data in accordance with said template after applying said format data to 
said content data to produce said visual form of data, said visual form of data being 
characterized by a plurality of dimensions represented using a coordinate system, said 
template including said extraction instruction used in identifying a location of a string 
included in said content data, said location of the string being represented using the 
coordinate system and corresponding to the location of string as represented in the 
visual form of data, said extraction instruction including information with respect to a 
reference marker and a direction in one of the plurality of dimensions where identifying 
at least some of the content data includes searching in the direction for identifying at 
least some of the content data in the direction; 

extracting a tag value for at least one tag identified in said template; and 
storing the identified at least some of content data in a database. 

25. (Currently Amended) A computer implemented method for producing a visual 
form of data comprising: 

receiving data representing a visual form of data, the data received comprising 
content data and format data indicating a manner in which the content data is to be 
visually represented, wherein said format data is applied to said content data to produce 
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said visual form of data, said visual form of data corresponding to one of a print format 
or a display format; 

receiving data indicating a location of selected data; 

forming an extraction instruction based on location data identifying the location of 
selected data; 

analyzing said visual form of data using a template and identifying at least some 
of the content data in accordance with said template after applying said format data to 
said content data to produce said visual form of data, said visual form of data being 
characterized by a plurality of dimensions represented using a coordinate system, said 
template including said extraction instruction used in identifying a location of a string 
included in said content data, said location of the string being represented using the 
coordinate system and corresponding to the location of the string as represented in the 
visual form of data, said extraction instruction including information with respect to a 
reference marker and a direction in one of the plurality of dimensions where identifying 
at least some of the content data includes searching in the direction for identifying at 
least some of the content data in the direction; 

extracting a tag value for at least one tag identified in said template to search or 
retrieve the visual form of data; and 

initiating performance of an action based on results of said identifying of at least 
some of the content data. 
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26. (Currently Amended) Computer readable media containing a computer program 
includes instructions for producing a visual form of data, comprising: 

receiving data representing the visual form of data, the data received comprising 
content data and format data indicating a manner in which the content data is to be 
visually represented, wherein said format data is applied to said content data to produce 
said visual form of data, said visual form of data corresponding to one of a print format 
or a display format; 

receiving data indicating a location of selected data; 

forming an extraction instruction based on location data identifying the location of 
selected data; 

analyzing said visual form of data using a template and identifying at least some 
of the content data in accordance with said template after applying said format data to 
said content data to produce said visual form of data, said visual form of data being 
characterized by a plurality of dimensions represented using a coordinate system, said 
template including said extraction instruction used in identifying a location of a string 
included in said content data, said location of said string being represented using the 
coordinate system and corresponding to the location of the string as represented in the 
visual form of data, said extraction instruction including information with respect to a 
reference marker and a direction in one of the plurality of dimensions where identifying 
at least some of the content data includes searching in the direction for identifying at 
least some of the content data in the direction; 

extracting a tag value for at least one tag identified in said template; and 
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initiating performance of an action based on results of said identifying at least 
some of the content data. 

27. (Currently Amended) Computer system for producing a visual form of data 
comprising: 

an input port receives data representing the visual form of data, the data received 
comprising content data and format data indicating a manner in which the content data 
is to be visually represented, wherein said format data is applied to said content data to 
produce said visual form of data, wherein said visual form of data corresponding to one 
of a print format or a display format, said input port receives data indicating a location of 
selected data; 

a processor forms an extraction instruction based on location data identifying the 
location of selected data, analyzes said visual form of data using a template, and 
identifies at least some of the content data in accordance with said template after 
applying said format data to said content data to produce said visual form of data, 

said processor initiates performance of an action based on results of said 
identification of at least some of the content data, where said visual form of data being 
characterized by a plurality of dimensions represented using a coordinate system, 
where said template including said extraction instruction used in identifying a location of 
a string included in said content data, said location being represented using the 
coordinate system and corresponding to the location of the string as represented in the 
visual form of data, wherein said extraction instruction including information with respect 
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to a reference marker and a direction in one of the plurality of dimensions where 
identifying at least some of the content data includes searching in the direction for 
identifying at least some of the content data in the direction, and 

said processor extracts a tag value for at least one tag identified in said template. 

50. (Currently Amended) A method computer implemented for processing a visual form 
of data comprising: 

receiving data representing the visual form of data, the data received comprising 
content data and format data indicating a manner in which the content data is to be 
visually represented, wherein said format data is applied to said content data to produce 
said visual form of data, said visual form of data corresponding to one of a print format 
or a display format; 

receiving data indicating a location of selected data; 

forming an extraction instruction based on location data identifying the location of 
selected data; 

analyzing said visual form of data using a template and identifying at least some 
of the content data in accordance with said template having an extraction instruction 
after applying said format data to said content data to produce said visual form of data, 
said visual form of data being characterized by a plurality of dimensions represented 
using a coordinate system, said template including said extraction instruction used in 
identifying a location of a string included in said content data, said location of the string 
being represented using the coordinate system and corresponding to the location of the 
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string as represented in the visual form of data, said extraction instruction including 
information with respect to a reference marker and a direction in one of the plurality of 
dimensions where identifying at least some of the content data includes searching in the 
direction for identifying at least some of the content data in the direction; 

extracting a tag value for at least one tag identified in said template; and 
storing the identified at least some of content data as at least one tag value. 

58. (Currently Amended) The method of claim 57, wherein storing the identified at 
least some of content data further includes storing the identified at least some of 
content data in association with the data representing a corresponding one of a 
plurality of visual forms of data. 

67. (Currently Amended) A method computer implemented for processing a visual 
form of data comprising: 

receiving data representing the visual form of data, the data received comprising 
content data and format data indicating a manner in which the content data is to be 
visually represented, wherein said format data is applied to said content data to produce 
said visual form of data, said visual form of data corresponding to one of a print format 
or a display format; 

receiving data indicating a location of selected data; 

forming an extraction instruction based on location data identifying the location of 
selected data; 
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applying a template to the visual form of data; 

analyzing said visual form of data using said template and identifying a portion of 
the content data in accordance with said template after applying said format data to said 
content data to produce said visual form of data, said template including extraction 
instructions indicating how to extract content data from the visual form of data, said 
visual form of data being characterized by a plurality of dimensions represented using a 
coordinate system, said template including said extraction instruction used in identifying 
a location of a string included in said content data, said location being represented 
using the coordinate system and corresponding to the location of the string as 
represented in the visual form of data, said extraction instruction including information 
with respect to a reference marker and a direction in one of the plurality of dimensions 
where identifying at least some of the content data includes searching in the direction 
for identifying at least some of the content data in the direction; and 

extracting, in accordance with at least one extraction instruction in said template, 
a tag value for at least one tag identified in said template. 

78. (Currently Amended) The method of claim 77, wherein storing the identified at 
least some of content data further includes storing the identified at least some of 
content data in association with the data representing a corresponding one of a 
plurality of visual forms of data. 



87. (Currently Amended) A system for processing a visual form of data comprising: 
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a data receiver receives data representing the visual form of data, the received 
data comprising content data and format data indicating a manner in which the content 
data is to be visually displayed, wherein said format data is applied to said content data 
to produce said visual form of data, said visual form of data corresponding to one of a 
print format or a display format, said data receiver receiving data indicating a location of 
selected data, an extraction instruction formed based on location data identifying the 
location of selected data; 

a template runner applies a template to said visual form of the data and analyzes 
said visual form of data using said template and identifies a portion of the content data 
used in generating at least one tag value after applying said format data to said content 
data to produce said visual form of data, said visual form of data being characterized by 
a plurality of dimensions represented using a coordinate system, said template including 
said extraction instruction used in identifying a location of a string included in said 
content data, said location of the string being represented using the coordinate system 
and corresponding to the location of the string as represented in the visual form of data, 
said extraction instruction including information with respect to a reference marker and a 
direction in one of the plurality of dimensions where identifying at least some of the 
content data includes searching in the direction for identifying at least some of the 
content data in the direction, a tag value being extracted for at least one tag identified in 
said template; and 

a database in which said template is stored. 
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92. (Currently Amended) A computer program product stored in a storage medium 
and used to processing a visual form of data comprising: 

a machine executable code receives data representing the visual form of data, 
the data received comprising content data and format data indicating a manner in which 
the content data is to be visually represented, wherein said format data is applied to 
said content data to produce said visual form of data, said visual form of data 
corresponding to one of a print format or a display format; 

a machine executable code receives data indicating a location of selected data; 

a machine executable code forms an extraction instruction based on location 
data identifying the location of selected data; 

machine executable code analyzes said visual form of data using a template and 
identifies at least some of the content data in accordance with said template having an 
extraction instruction after applying said format data to said content data to produce 
said visual form of data, said visual form of data being characterized by a plurality of 
dimensions represented using a coordinate system, said template including said 
extraction instruction used in identifying a location of a string included in said content 
data, said location of the string being represented using the coordinate system and 
corresponding to the location of the string as represented in the visual form of data, said 
extraction instruction including information with respect to a reference marker and a 
direction in one of the plurality of dimensions where identifying at least some of the 
content data includes searching in the direction for identifying at least some of the 
content data in the direction; 
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a machine executable code extracts a tag value for at least one tag identified in 
said template; and 

a machine executable code stores the identified at least some of content data in 
a database. 

93. (Currently Amended) A computer program product stored in a storage 
medium and used to produce a virtual form of data in a computer system comprising: 

a machine executable code receives data representing the visual form of data, 
the data received comprising content data and format data indicating a manner in which 
the content data is to be visually represented, wherein said format data is applied to 
said content data to produce said visual form of data, said visual form of data 
corresponding to one of a print format or a display format; 

a machine executable code receives data indicating a location of selected data; 

machine executable code that forms an extraction instruction based on location 
data identifying the location of selected data; 

a machine executable code applies a template to the visual form of data; 

machine executable code analyzes said visual form of data using said template 
and identifies a portion of the content data in accordance with said template, said 
template including extraction instructions indicating how to extract content data from the 
visual form of data after applying said format data to said content data to produce said 
visual form of data, said visual form of data being characterized by a plurality of 
dimensions represented using a coordinate system, said template including said 
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extraction instruction used in identifying a location of a string included in said content 
data, said location of the string being represented using the coordinate system and 
corresponding to the location of the string as represented in the visual form of data, said 
extraction instruction including information with respect to a reference marker and a 
direction in one of the plurality of dimensions where identifying at least some of the 
content data includes searching in the direction for identifying at least some of the 
content data in the direction; 

a machine executable code extracts a tag value for at least one tag identified in 
said template; and 

a machine executable code stores the identified at least some of content data as 
at least one tag value. 
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Allowable Subject Matter 

4. Claims 1-8, 12-19, 25-27, 50, 52-88, 91-93 are allowed. 

The prior art of record alone or in combination, does not teach or fairly suggest 
the combination of steps as recited in independent claim 1 , wherein "analyzing said 
visual form of data using a template and identifying at least some of the content data in 
accordance with said template after applying said format data to said content data to 
produce said visual form of data, said visual form of data being characterized by a 
plurality of dimensions represented using a coordinate system, said template including 
said extraction instruction used in identifying a location of a string included in said 
content data, said location of the string being represented using the coordinate system 
and corresponding to the location of the string as represented in the visual form of data, 
said extraction instruction including information with respect to a reference marker and a 
direction in one of the plurality of dimensions where identifying at least some of the 
content data includes searching in the direction for identifying at least some of the 
content data in the direction; extracting a tag value for at least one tag identified in said 
template; and storing the identified content data"; 

The prior art of record alone or in combination, does not teach or fairly suggest 
the combination of steps as recited in independent claims 17, 19 and 50, wherein 
"analyzing said visual form of data using a template and identifying at least some of the 
content data in accordance with said template after applying said format data to said 
content data to produce said visual form of data, said visual form of data being 
characterized by a plurality of dimensions represented using a coordinate system, said 
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template including said extraction instruction used in identifying a location of a string 
included in said content data, said location of the string being represented using the 
coordinate system and corresponding to the location of the string as represented in the 
visual form of data, said extraction instruction including information with respect to a 
reference marker and a direction in one of the plurality of dimensions where identifying 
at least some of the content data includes searching in the direction for identifying at 
least some of the content data in the direction; extracting a tag value for at least one 
tag identified in said template; and storing the identified content data as at least one 
tag value"; 

The prior art of record alone or in combination, does not teach or fairly suggest 
the combination of steps as recited in independent claim 18, wherein "a processor forms 
an extraction instruction based on location data identifying the location of selected data, 
analyzes said visual form of data using a template and identifies at least some of the 
content data in accordance with said template after applying said format data to said 
content data to produce said visual form of data, wherein said visual form of data being 
characterized by a plurality of dimensions represented using a coordinate system, 
wherein said template including said extraction instruction used in identifying a location 
of a string included in said content data, said location of the string being represented 
using the coordinate system and corresponding to the location of the string as 
represented in the visual form of data, said extraction instruction including information 
with respect to a reference marker and a direction in one of the plurality of dimensions 
where identifying at least some of the content data includes searching in the direction 
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for identifying at least some of the content data in the direction, said processor 
extracting a tag value for at least one tag identified in said template; and a storage 
media stores the identified the at least some of content data as at least one tag value"; 

The prior art of record alone or in combination, does not teach or fairly suggest 
the combination of steps as recited in independent claims 25 and 26, wherein 
"analyzing said visual form of data using a template and identifying at least some of the 
content data in accordance with said template after applying said format data to said 
content data to produce said visual form of data, said visual form of data being 
characterized by a plurality of dimensions represented using a coordinate system, said 
template including said extraction instruction used in identifying a location of a string 
included in said content data, said location of the string being represented using the 
coordinate system and corresponding to the location of the string as represented in the 
visual form of data, said extraction instruction including information with respect to a 
reference marker and a direction in one of the plurality of dimensions where identifying 
at least some of the content data includes searching in the direction for identifying at 
least some of the content data in the direction; extracting a tag value for at least one tag 
identified in said template; and initiating performance of an action based on results of 
said identifying of at least some of the content data" 

The prior art of record alone or in combination, does not teach or fairly suggest 
the combination of steps as recited in independent claim 27, "said processor initiates 
performance of an action based on results of said identification of at least some of the 
content data, where said visual form of data being characterized by a plurality of 
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dimensions represented using a coordinate system, where said template including said 
extraction instruction used in identifying a location of a string included in said content 
data, said location being represented using the coordinate system and corresponding to 
the location of the string as represented in the visual form of data, wherein said 
extraction instruction including information with respect to a reference marker and a 
direction in one of the plurality of dimensions where identifying at least some of the 
content data includes searching in the direction for identifying at least some of the 
content data in the direction, and said processor extracts a tag value for at least one tag 
identified in said template"; 

The prior art of record alone or in combination, does not teach or fairly suggest 
the combination of steps as recited in independent claim 67, wherein "analyzing said 
visual form of data using said template and identifying a portion of the content data in 
accordance with said template after applying said format data to said content data to 
produce said visual form of data, said template including extraction instructions 
indicating how to extract content data from the visual form of data, said visual form of 
data being characterized by a plurality of dimensions represented using a coordinate 
system, said template including said extraction instruction used in identifying a location 
of a string included in said content data, said location being represented using the 
coordinate system and corresponding to the location of the string as represented in the 
visual form of data, said extraction instruction including information with respect to a 
reference marker and a direction in one of the plurality of dimensions where identifying 
at least some of the content data includes searching in the direction for identifying at 



Application/Control Number: 09/478,156 Page 22 

Art Unit: 2162 

least some of the content data in the direction; and extracting, in accordance with at 
least one extraction instruction in said template, a tag value for at least one tag 
identified in said template"; 

The prior art of record alone or in combination, does not teach or fairly suggest 
the combination of steps as recited in independent claim 87, wherein a template runner 
applies a template to said visual form of the data and analyzes said visual form of data 
using said template and identifies a portion of the content data used in generating at 
least one tag value after applying said format data to said content data to produce said 
visual form of data, said visual form of data being characterized by a plurality of 
dimensions represented using a coordinate system, said template including said 
extraction instruction used in identifying a location of a string included in said content 
data, said location of the string being represented using the coordinate system and 
corresponding to the location of the string as represented in the visual form of data, said 
extraction instruction including information with respect to a reference marker and a 
direction in one of the plurality of dimensions where identifying at least some of the 
content data includes searching in the direction for identifying at least some of the 
content data in the direction, a tag value being extracted for at least one tag identified in 
said template; and a database in which said template is stored"; and 

The prior art of record alone or in combination, does not teach or fairly suggest 
the combination of steps as recited in independent claim 92, "wherein machine 
executable code analyzes said visual form of data using a template and identifies at 
least some of the content data in accordance with said template having an extraction 
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instruction after applying said format data to said content data to produce said visual 
form of data, said visual form of data being characterized by a plurality of dimensions 
represented using a coordinate system, said template including said extraction 
instruction used in identifying a location of a string included in said content data, said 
location of the string being represented using the coordinate system and corresponding 
to the location of the string as represented in the visual form of data, said extraction 
instruction including information with respect to a reference marker and a direction in 
one of the plurality of dimensions where identifying at least some of the content data 
includes searching in the direction for identifying at least some of the content data in the 
direction; a machine executable code extracts a tag value for at least one tag identified 
in said template; and a machine executable code stores the identified at least some of 
content data in a database"; and 

The prior art of record alone or in combination, does not teach or fairly suggest 
the combination of steps as recited in independent claim 93, wherein, "machine 
executable code analyzes said visual form of data using said template and identifies a 
portion of the content data in accordance with said template, said template including 
extraction instructions indicating how to extract content data from the visual form of data 
after applying said format data to said content data to produce said visual form of data, 
said visual form of data being characterized by a plurality of dimensions represented 
using a coordinate system, said template including said extraction instruction used in 
identifying a location of a string included in said content data, said location of the string 
being represented using the coordinate system and corresponding to the location of the 
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string in as represented the visual form of data, said extraction instruction including 
information with respect to a reference marker and a direction in one of the plurality of 
dimensions where identifying at least some of the content data includes searching in the 
direction for identifying at least some of the content data in the direction; a machine 
executable code extracts a tag value for at least one tag identified in said template; and 
a machine executable code stores the identified at least some of content data as at 
least one tag value. 

The dependent claims, bring definite, further limiting, and fully enabled by the 
specification are also allowed. 
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5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Cam Y T. Truong whose telephone number is (571) 
272-4042. The examiner can normally be reached on Monday to Firday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Breene can be reached on (571 ) 272-4107. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-21 7-91 97 (toll-free). / 
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